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2.1.4 Unordered Sampling with Replacement 

Among the four possibilities we listed for ordered/unordered sampling with/without 
replacement, unordered sampling with replacement is the most challenging one. Suppose that 
we want to sample from the set A — {a,}, 0 - 2 , , Cl n } k times such that repetition is 

allowed and ordering does not matter. For example, if A — {1,2,3} and k — 2, then 
there are 6 different ways of doing this 

• U; 

• 1 , 2 ; 

• 1,3; 

• 2 , 2 ; 

• 2,3; 

• 3,3; 

How can we get the number 6 without actually listing all the possibilities? One way to think 
about this is to note that any of the pairs in the above list can be represented by the number of 
l’s, 2's and 3's it contains. That is, if X\ is the number of ones, X 2 is the number of twos, and 
X 3 is the number of threes, we can equivalently represent each pair by a vector 
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Note that here Xi > 0 are integers and X\ + X 2 + X 3 — 2 . Thus, we can claim that the 
number of ways we can sample two elements from the set A — { 1 , 2 , 3 } such that ordering 
does not matter and repetition is allowed is the same as solutions to the following equation 

x\ + X2 + £3 = 2 , where Xi e {0,1,2}. 

This is an interesting observation and in fact using the same argument we can make the 
following statement for general k and 71. 

Lemma 2.1 

The total number of distinct k samples from an 72-element set such that repetition is allowed 
and ordering does not matter is the same as the number of distinct solutions to the equation 
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x\ + X 2 +- • • +x n — k, where X{ £ { 0 , 1 , 2 , 3 ,... }. 

So far we have seen the number of unordered /c-samples from an 77 element set is the same as 
the number of solutions to the above equation. But how do we find the number of solutions to 
that equation? 

Theorem 2.1 

The number of distinct solutions to the equation 

x\ + X 2 +. ■ ■ +x n — k, where Xi € {0, 1,2,3, ...} (2.3) 

is equal to 

fn + k — l\ fn + k — l\ 

V k ) = \ n- 1 )' 

Proof 

Let us first define the following simple mapping in which we replace an integer Xi + 0 with 
X{ vertical lines, i.e., 


1 -> 
2 -> 

3 


Now suppose we have a solution to the Equation 2.3. We can replace the X{ s by their 
equivalent vertical lines. Thus, for example if we have 

X\ + X 2 + #3 + £4 = 3 + 0 + 2 + 1, we can equivalently write 111 + +11 + | • 

Thus, we claim that for each solution to the Equation 2.3, we have unique representation using 
vertical lines (' | ’) and plus signs (’+’). Indeed, each solution can be represented by k vertical 
lines (since the Xi sum to k) and 71 — 1 plus signs. Now, this is exactly the same as Example 
2.7 : how many distinct sequences you can make using k vertical lines (|) and 77 — 1 plus 
signs (+)? The answer as we have seen is 

fn + k— 1\ fn + k — 1\ 

V * ) = V n-l )■ 


Example 2.12 
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Ten passengers get on an airport shuttle at the airport. The shuttle has a route that includes 5 
hotels, and each passenger gets off the shuttle at his/her hotel. The driver records how many 
passengers leave the shuttle at each hotel. How many different possibilities exist? 

• Solution 

o Let Xi be the number of passengers that get off the shuttle at Hotel i. Then we 
have 


— 10, where Xi E {0,1,2,3, 

Thus, the number of solutions is 

m-errM?)- 


Let's summarize the formulas for the four categories of sampling. Assuming that we have a set 
with n elements, and we want to draw k samples from the set, then the total number of ways 
we can do this is given by the following table. 


ordered sampling with replacement 

n k 

ordered sampling without replacement 

pn _ n\ 

k ~ ( n -k)\ 

unordered sampling without replacement 

/n\ _ n! 

\k) ~ k\(n-k)\ 

unordered sampling with replacement 

rn 


Table 2.1: Counting results for different sampling methods. 


<— previous 
next —> 


https://www.probabilitycourse.com/chapter2/2_1_4_unordered_with_replacement.php 


3/3 




